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Abstract 

In this paper, we establish and prove analytical properties of the state operator em- 
bedded in an optimal control problem, in the context of dynamic user equilibrium (DUE) 
models (Friesz et al. 1993). 



1 Introduction 

This paper considers a very general differential variational inequality formulation of the dy- 
namic traffic assignment problem and characteristics of the travel delay or latency operator 
that assure a solution exists. Because the delay operator is the outcome of a separate differ- 
ential algebraic equation (DAE) model that expresses unit travel time for each state (volume) 
encountered, it is referred to herein as the "state operator" . 



2 Preliminaries 

Theorem 2.1. (Contraction mapping theorem) Let X be a Banach space, O a metric 
space, and let $ : © x X — > X be a continuous mapping such that, for some k < 1, 

||S(0, x) -S(0, < «||a;-y|| V0, x, y (2.1) 

Then for each G O there exists a unique fixed point x(9) el such that 

x{9) = <5>(9, x{6)) (2.2) 

The map 9 i— > x(9) is continuous. Moreover, for any 9 G O, y G X one has 

\\v-<0)\\ < -^—\\y-H9,y)\\ (2.3) 
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We begin by considering the control vector 

ue (C 2 [t , t f }) m 

and associated operator 

x(u, t) = arg = f{y(t), u(t), t), y(t ) = x , T[y(t f ), t f ]=0\e {C%, t f ]) n (2.4) 



where 



x € R n (2.5) 

/ : R n x R m x R 1 — > R n (2.6) 

r : Cxi 1 — ► R n (2.7) 

(£ 2 [to, tf]) m is the m-fold product of the space of square-integrable functions C 2 [to, tf] with 
inner product defined by 

/"*/ 

(u, v) = [u(t)] T v(t) dt (2.8) 



J to 

where superscript T stands for transpose of vectors. The entity x(u, t) is to be interpreted as an 
operator that tells us the state vector x for each control vector u and each time t € [to, tf] Cl 
when there are end point conditions which the state variables must satisfy. Working with this 
operator is, in effect, a supposition that a two point boundary value problem involving the 
state variables has a solution for each control vector considered. Note that constraints on 
u are enforced separately Q, so in working with x{u, t) we are not presuming existence of a 
solution of the variational inequality to be articulated below. 

Furthermore, we assume that every control vector is constrained to lie in a set 

U C (C%, t f ]) m 

where U is defined so as to ensure the terminal conditions imposed on the state variables 
may be reached from the initial conditions intrinsic to (|2.4p . Given the operator (|2.4p . the 
variational inequality of interest to us takes the following form: 

find u* G U such that 

(F(x(u*),u*,t),u-u*\ > VnGC/ (2.9) 

where 

F: (C [t ,t f ]) n x(£ 2 [t ,t f ]) m xRi _> (£ 2 [t , t f ]) m 

Note that, by virture of the inner product (|2.8p . we may state the variational inequality (j2.9j) 

as 

"tf 



F(x(u*),u*,t),u-u*\ = / [F(x(u*), u*,t)] (u-u*) > 



[X[u ), u , t)\ J 

to 

We refer to (12.9P as a differential variational inequality with explicit controls and give it the 
symbolic name DVI(F, /, U). 



1 This definition of x(u, t) is precisely that given by Minoux (1986) when analyzing optimal control problems 
from the point of view of infinite dimensional mathematical programming. Moreover, unless other conditions 
are satisfied x(u, t) is not a solution of the variational inequality considered in (|2.9[) : rather it should be thought 
of as a parametric representation of the state vector in terms of the controls, note also that we do not actually 
have to explicitly solve for x(u, t), as is made clear in our subsequent analysis. 
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3 Regularity Conditions for Differential Variational Inequali- 
ties with Controls 



To analyze (|2.9p we need the following notion of regularity. 

Definition 3.1. (Regularity of DVI{F, f, U)) We call DVI{F, f, U) regular if 

1. The state operator (C 2 [to, tj]) m — > (C°[io, : u ^ x(u, •) exists and is continuous 
and G- differ •entiable with respect to u; 

2. T(x, t) is continuously differentiable with respect to x; 

3. F(x, u, t) is continuous with respect to x and u; 

4- /(x, u, t) is convex and continuously differentiable with respect to x and u; 

5. U is convex and compact; and 

6. xq £ M. n is known and fixed. 

The motivation for this definition of regularity is to parallel as closely as possible those as- 
sumptions needed to analyze traditional optimal control problems from the point of view of 
infinite dimensional mathematical programming. 

To analyze the existence, continuity and differentiability of the state operator, we rely on the 
following assumption. 

(A) The set U = {u(t) : t & [to, tf], u € U} C M m of control values is compact. The function 
/ = /(x, u, t) is defined and continuous on the space M n xUxl, continuously differentiable 
with respect to x, and satisfies 

\f(x, u, t)\ < C, \\D x f(x, u, t) || < L (3.10) 

for some constants C, L and all x, u, t. 

4 Properties of the state operator 
4.1 Existence of the state operator 

The existence of the state operator is an essential issue we must explore. Let us begin with 
the following theorem to establish the existence of a solution to an ODE. 

Theorem 4.1. (existence of the solution to ODEs) Let us consider an initial value 
problem 

rjqr 

- = f(x, u, t) (4.11) 

x(i ) = x (4.12) 
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for t € [to, tf}. Suppose f(x, u, t) is Lipschitz continuous in x for all t € [to, tf], i.e., the 
condition 

\f(x, u, t) — f(x, u, t)\ < L\x — x\ (4-13) 

holds for all x, hatx and a constant L > 0. Then the initial value problem ft4-ll\ )- [4-lty has 
a unique solution x(t) for t € [to, tf]. 



Proof. Following Walter (1988), we begin by writing an equivalent fixed point problem. For 
each fixed control u, the trajectory x(-, u) is the fixed point of the transformation w i— > $>(u, w) 
defined by 

$(u,x)(t) = x + f(x(s),u(s),s)ds (4-14) 
Jta 

The map $ is well defined by assumption (A). Our strategy is to show the existence of the 
fixed point via the Contraction Mapping Theorem (Theorem 12 . X [) . We define the norm on 
C°[t , t f ] 

{|x(t)|e- Q *: t€[to,t f ]} (4.15) 



\w\\n = max 



for a constant a > to be determined later. Then observe 



x){t) - $(<u, x){t)\ 



f(x{s), u(s), s) - f(x(s), u(s), s) ds 



< / L\x(s) — x(s)\ ds 

Jto 

L\x(s) -x{s)\e~ as e as ds 

'to 

L\\x-x\\ / e as ds 

II Wet I 

Jto 



which leads to 



and therefore 



< L \\x — x\\ — 

- II lla a 



x)(t) - $(tf, x)(t)|e _a * < -\\x-x\ 
1 a ii i 



|$(n, x)(t) - $(u, x)(t)\\ < — \\x — x\ 

I lla CK " 1 



a 



Choose a = 2L for example, the operator $(«, •) is a contraction mapping with constant |. 
By Theorem 12. 11 a unique x*(t) satisfying the fixed point problem (|4,14p exists, this completes 
the proof. □ 



Theorem 14. II states that given any u & U, a unique trajectory x(u, ■) exists for all t € [to, tf]. 
Thus the state operator exists and is well-defined. 

Theorem 4.2. (Continuity of state operator) Let the assumption (A) hold. Then the 
map u i — ^ x(u, •) is continuous from (£ 2 [to, t/]) m into (C°[to, t/]) n . 
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Proof. We follow the proof by Bressan and Piccoli (2005). Recall that the trajectory x(u, 
is the fixed point of the transformation w i— > $(u, u>) defined by 



$(n, x)(t) = x + f(x{s),u(s),s)ds 



to 



To show the continuity, let {u n } nGN be a sequence of controls converging to n in the L 2 -norm. 
Then u n also converges to u in the L -norm, thus for any subsequence u n > we can extract a 
further subsequence u n » such that u n " converges to u for almost every t € [to, t/]- According 
to the first inequality of (|3.10|) and the Dominated Convergence Theorem, 



n" — >oo 



lim / \f(x(s), u(s), s) - f(x(s), u n »(s), s)\ ds = 



to 







1 < 






J to 



Since the subsequence n' is arbitrary, we conclude that the above limit holds for the entire 
sequence u n . Thus 

(s), u n (s), s) - f(x(s), u(s), s) I ds — > 

We conclude that $(u n , x) converges to $(u, x) uniformly on [to, tf]. This proves the conti- 
nuity of $ with respect to u. □ 

Next let us give a differentiability property of the state operator with respect to the control 
in the Gateaux sense. 

Theorem 4.3. (Differentiability of the state operator w.r.t. the control) In addition 
to the assumption (A), assume that f is continuously differentiable in an open neighborhood 
V of U. Let u(-) G U whose corresponding trajectory x(u, •) is defined on [to, tf]. Then for 
every bounded measurable Ait(-) and every t € [to, tf], x(u, •) is G- differentiable with respect 
to u. That is, the derivative 

5x(u, An) ^ hm^ + eAn, t) - x(u, t) 

exists for every such Ait. In particular, 

5x(u, An) = J M(t, x)D u f(x(u, x), n(s), s) • Au(s)ds (4.17) 

where D u f denotes the matrix of partial derivatives jJ^, and M is the matrix fundamental 
solution for the linearized problem 

v(t) = D x f(x(u,t),u(t),t) -v(t) (4.18) 

Proof. We follow the proof by Bressan and Piccoli (2005). Let z(t) be the RHS of P~T7) . By 
Theorem 3.2.6 in Bressan and Piccoli (2005), z is a solution to 

i(t) = A(t) z(t) + D u f(x(u, t), u(t), t) ■ Au(t), z(t ) = (4.19) 

where A(t) = D x f(x(u, t), u(t), t). If we define 

x e (t) = x(u + eAu,t) 
y £ (t) = x(u, t) +ez(t) 
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To prove (|4.17|) . it suffices to show that 



lim 



(4.20) 



Notice that x e is the fixed point of the map w h-> <3?(u + eAu, w) defined in ()4.14p . which 
is contractive with respect to the norm || ■ || a as in (I4.15j) . Choosing a = 2L together with 
estimate f|2.3|) yields 

1 ii , 2 . 

-\\xe-ye\\ 2 L ^ _ \\<P{u + eAu) - y s \\ 



To prove (|4,2U|) . it suffices to show that 

1 



lim sup 

Wo,*/] £ 



xo + 



f{ye(s),u + eAu, s)ds-y e (t)^j 



(4.21) 



Recalling the definition of y e {), we obtain 



xo+ f{ye(s),u + eAu,s)ds-y e (t) 
Jt 

xq + f(x(u, s) + ez(s), u + eAu, s) ds — x(u, t) — ez(t) 



xo + f[x(u,s),u(s),s)ds + / D x f(x(u, s), u(s), s) ■ ez(s) ds 

J to J to 

+ / D u f(x(u, s), u(s), s) ■ eAu(s) ds — ez(t) 

J to 

t ri 

r 

't 

t I I [D u f(x(u, s) + aez(s), u(s) + aeAu(s), s) — D u f(x(u, s), u(s), s)] • ez(s) dads 



/ / [D x f(x(u, s) + aez(s), u(s) + aeAu(s), s) — D x f(x(u, s), u(s), s)] • ez(s) dads 
J t Jo 



t JO 

< I / \\D x f(x(u, s) + aez(s), u(s) + asAu(s), s) — D x f(x(u, s), u(s), s) || • \z(s)\ dads 
Jt Jo 

+ I J \\D u f [x(u, s) + aez(s), u(s) + aeAu(s), s) — D u f [x(u, s), u(s), s)\\ ■ \Au(s)\ dads 
Jt Jo 

By the Dominated Convergence Theorem, the above right hand side converges to zero as 
e -> 0, proving (|4.2ip and hence (|4.20p . □ 



5 Application to Dynamic User Equilibrium 

5.1 Review of the differential variational inequality formulation of DUE 



We will assume the following planning time horizon for the time being 

[t , tf] C R+ 
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The most crucial component of the DUE model is the path delay operator, which provides 
the time delay on any path p per unit flow departing from the origin of that path. The delay 
operator is denoted by 

D p (t,h) VpeT 

where V is the set of all paths employed by network users, t denotes the departure time, h is 
a vector of departure rates. Throughout the rest of the paper, we stipulate that 

he (r. 2 .; /„. ■ 1 J/ 



/ „ \IPI 

where (£+([to, tf])) denotes the non-negative cone of the |"P|-fold product of the Hilbert 
space C 2 ([to, tf]) of square-integrable functions on the compact interval [to, tf]. The inner 
product of the Hilbert space ^£ 2 ([to, tf])) is defined as 

*/ 
to 



(u,v) = / (u(s)y v(s) ds (5.22) 
Jt 

where the superscript T denotes transpose of vectors. This inner product induces the norm 

||«|L 2 = ( n , u) 1 ^ 2 (5.23) 

Next, for each p G V, we define the effective unit path delay operator ^f p : [to, tf] x 
\V\ 

-)■ R via 



(£+([to, t 



%(t,h) = D p (t,h)+T[t + D p (t,h)-T A ) (5.24) 



where J-(-) is the penalty for early or later arrival relative to the target arrival time Ta- 
We interpret ^ p (t, h) as the perceived travel cost of driver starting at time t on path p 
under travel conditions h. Presently, our only assumption on such costs is that for each h € 

^/^_([to, tf])) 5 the function ^(-, h) : [to, tf] — > R is measurable. This minimal assumption 
was used for a measure theory-based argument in [2]. 

To support the development of a dynamic network user equilibrium model in the following, 
we introduce some additional constraints, namely, the flow conservation constraints, 

^2 h p (t) dt = Qij V (i, j) e W (5.25) 



pep. 



where V%j is the set of all paths that connect origin-destination (O-D) pair (i, j). W is the 
set of all O-D pairs. In addition, Q, L j is the fixed travel demand for O-D pair (i, j). Using 
the notation and concepts we have mentioned, the feasible region for DUE when the effective 
delay operator $(-, •) is given is 



A 



h e (4([t , */])) lVl Y, 1* h p^ dt = Qv V ^ ( 5 ' 



26) 



The following definition of dynamic user equilibrium was first articulated in [2]: 
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Definition 5.1. (Dynamic user equilibrium). A vector of departure rates (path flows) 
h* G A is a dynamic user equilibrium if 

h* p (t) > 0,p G Pij % [t, h* (t)] = % - (5.27) 

We denote this equilibrium by DUE , A, [to^/])- 

Using measure theoretic argument, Friesz et al. (1993) established that a dynamic user equilib- 
rium is equivalent to the following variational inequality under suitable regularity conditions: 

find h* G A such that 

I ' * P (t, - > I vih, A, [t , t/f) (5.28) 

V/i e A J 

It has been reported in Friesz et al. (2010) that (|5.28p is equivalent to a differential variational 
inequality. This is most easily seen by noting that the flow conservation constraints may be 
re-stated as 



dt 



M*) 

-- 



Yijitf) — Qij 



(5.29) 



which is recognized as a two boundary value problem. As a consequence (15.280 may be re- 
written as the following differential variational inequality (DVI): 



find h* G Ai such that 

f s %(t,h*)(h p -h* p )dt>o 



pev 



V/t G Ai 



DVl(%Ai,[ta, 



(5.30) 



where 



Ai 



h>0: — 
dt 



C Ui([t , t 



■- hp(t), Yij(t ) = 0, Y iS (t f ) = Qij, V(t, j) G W 



5.2 The state operator 

In this section, we will apply the results established in Section 0] to the DVI (|5.30p . and obtain 
properties of the state operator in DVl{^> , Ai, [to, t/]) such as existence and regularity. These 
properties of the state operator will allow us to further analyze DVIy$>, Ai, [to, tf]). 
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We begin by identifying the control set U = Aj, and control h £ U. The state variable becomes 
Y = (Yij(h, t)) G (C°[i , i/]) l>V| - Then the abstract definition of state operator ([2H)-([277D 
can be instantiated as following 

Y(h,t) = |y : ^- = f(Y,h,t), Y(t ) = Y , T[Y(t f ),t f ] = V(i,j)ew\ 

G (C°[t ,t/]) |W| (5.31) 

where 

y = G (5.32) 

/:Rf 1 xRf xl 1 — ► Mfl, [/(F, fc, i)] .. = J2 h P> V ^) £W ( 5 - 33 ) 

r : rJWI x M i _^ R \W\ } [ T [Y, t]] y = - Q ii5 V(», j) G W (5.34) 

The following results are straightforward. 

Proposition 5.2. (Existence and continuity of the state operator) The state operator 
h i — y Y(h, •) is well-defined and is continuous from Ai into (C°[to, tf]) 

Proposition 5.3. (G-differentiability of the state operator) Let h(-) G Ai be a control 
whose corresponding solution Y(h, •) is defined on [to, tf]. Then for every bounded measurable 
Ah(-) and every t G [to, tf], the map e i-> Y(h + eA/i, t) is differentiable. In particular, if the 
derivative is defined as 

£->0 £ 

Then 

6Y(h, Ah) G R m , [SY(h,Ah)].. 
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